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1 .  INTRODUCTION 


In  a  companion  paper,  the  authors  (see  Bai,  Krishnaiah  and  Zhao  (1986)) 
considered  the  problem  of  estimation  of  the  number  of  signals  and  the  frequencies 
of  these  signals  under  a  signal  processing  model  with  multiple  sinusoids.  The 
number  of  signals  was  estimated  by  using  an  information  theoretic  criterion.  They 
have  also  established  the  strong  consistency  of  their  estimates.  In  this  paper, 
we  establish  the  rates  of  convergence  of  the  above  estimates  of  the  number  of 
signals  and  frequencies. 


2 


2.  PRELIMINARIES  AND  STATEMENT  OF  PROBLEM 


Consider  the  model 


0 

^n)  =  £  a  ,exp(  ini  .n)  +  w(n),  n  =  1,2,.  . .  ,N 

j=l  J  J 


(2.1) 


where  i  =  /-l,  {a^}  is  a  set  of  complex  amplitudes,  {ojj}  is  a  set  of  frequencies 

and  (w(n)}  is  the  noise  sequence  of  independent  and  identically  distributed 

2  2 

(i.i.d.)  complex  random  variables  with  mean  zero  and  E|w(n)|  =  a  <  00 .  We  assume 

that  the  frequencies  uk6(0,2it)  are  different  from  each  other.  Also,  yin)  is 
complex  valued  spatial  sample  observed  at  n-th  array  element.  We  will  now  des¬ 
cribe  the  method  of  estimation  of  t^,  the  number  of  signals,  and  uk's,  the 
frequencies,  considered  in  our  earlier  paper  (Bai,  Krishnaiah  and  Zhao(1986)).  To 


determine  t_,  it  is  assumed  a  prior  that  tQ  <  T  <  ».  Let 


st  "  mln((tTt7  L'L  btUy<n'u|2) 


12.2) 


n=t+l  e=o 


for  t  =  where  the  coefficients  b  are  subject  to  the  restriction 

t  ^ 

y  I |  =  1 .  Also,  let 


Rt  =  St  +  tCN 


where  satisfies  the  following  restrictions: 


(2.3) 


(  i )  lim  C.  *  0 
..  N 
N-*°° 


(ii)  lim{vN  C^/v loglogN}  =  «. 
N-~  N 


(2.4 ) 


The  proposed  estimate  of  t^  is  given  by  t^  where  t^  is  given  by 


R-  =  min{R  ,R  . R  ) 

0 


(2.5) 


Now,  let  b  =  (bg,...,b-  )'  be  such  that 


S-  = 


.  N 

—  I 


E0  n=t0H  M  * 


I^b  vin-u (" 


and  let  p^expCioO  be  the  roots  of 


t 

I 

j=0 


H(z)  =  b^zJ 


(2.6) 


(2.7) 


where  p  ,  ^  0  and  cu.  €[0,2tt)  for  j  1> .  •  *  »t^.  Then  lu.  , .  •  * , u>  were  estimated  with 
J  J  u  i  i.Q 

u>.  respectively.  The  strong  consistency  of  £  and  iL.'s  was  also 

1  t0  u  J 

established.  In  this  paper,  we  are  interested  in  establishing  the  rates  of 

convergence  of  the  above  estimates. 

Throughout  this  paper,  A*  and  A  respectively  denote  transpose  of  the  conjugate 


of  A  and  general  inverse  of  A. 


3.  CONVERGENCE  RATE  OF  THE  ESTIMATE  OF  THE  NUMBER  OF  SIGNALS 


In  this  section,  we  establish  the  rate  of  convergence  of  t^.  Let 

.(t)  i  N  _ 

=  fTt  l  y(n-i)  y(n-m)  ,  m=0,l . t,  (3.1) 

n=t+l 

and  r(t)  =  (yj^).  Also,  let  b  =  , bjt) , . . . , b^t) ) '  be  such  that 


St  =  N-t  ^  I  l  b(t)y(n-lc)|2. 

*  n=t+l  1=0 

Here  we  note  that  S^  is  the  smallest  eigenvalue  of  the  matrix 

Denote  by  6.  the  Kronecker  delta.  Write 

J  dm 

vO,  ,2  i(m-£)u)i  2 

't.- •  3  +  <”V 

and  r(t>  ■  (x  )  for  0  <  l,  m  <  t.  We  can  write  xV^  as 
Jem  —  —  £m 

=  +  J,  +  Jn  +  J.,  +  J.  =  y.  +  V » 

im  Im  1  2  3  4  Im  Nim’ 

fo  —  i(mu)u- liw-j )  i  J?  in(u>-; -uii. ) 

Ji '  j.Li  a^e 


(3.2i 


(3.3) 


(3.4) 


pO  i(m-H)u)j  i  I?'  i(n- 

J2  =  /,  aj  e  iPt  1‘ 

j=l  J  n=t+l 

f 0  -  i(m-t)u)-j  i  -i(n-i)uj^ 

J3  ■  ),  aj  8  iTt  8 

j=l 


i(n-m)u)d 


w(n-m) 


w(n-H) 


(3.5l 


J4  =  N-t  I  lw(n-Uw(n-ml-  i^o2]. 
n=t+l 

Write  the  eigenvalues  of  as  A^ ^  _>  . . .  _>  A^^  >  0.  From  the  structure  of 

r(t,),  we  have,  for  any  t  _>  1 , 


E 


E 


and  for  t  _>  tg 


,(t)  _  At)  _  _  At)  _  2 

At  ‘  At  +1  ‘  *•*  ”  At  ‘  0 
0  0 


(t)  A(t0’U  >  2 

V  -  V1  ° 


(3.6) 


(tfl'D  -) 

Now,  let  A  =  A  -  o“.  Also,  denote  the  eigenvalues  of  T(t)  by 

to'i 


>_  A^1"^  ^  .  . .  _>  ^hen  by  Lemma  2.1  in  Bai,  Krishnaiah  and  Zhao  (1985; 


we  have 


l  (*<,t)-i|t))2  <  trtf^'-r'")' 

4=0 


;(t)  _ ( t )  . 2 


Also,  since  A^  =  St>  we  have 


jSt-A^t)|  <  /tr(r(t)-rU))2  t  =  0,1,2 . T. 


If  t  >  tg,  then 


tr(ru)- r(t);2  <  i  cN2 


.(tn)  u n)  0  7 

tnr  0  -r  0  r  <  i  c/ 


implies  that 


Rt  "  RtQ  “  St  StQ  +  U_t0)CN 


>  C„  -(v'tr(rU)-f(t ]  )2  + 


;  +  v  t  r  ( r  -  r 


(3.7; 


(3.8) 


(3.9) 


(3.10) 


(3.11) 


vwvv*  v»  vtstv 
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Here  we  use  the  fact  that 


(t) 


(tQ  J 


2 

a  . 


Hence  t  t  t.  If  t  <  t 
0 


tr(r('t)-r(t) r  < 


and  (.3.10)  implies  that 


StQ  -  (Vt)CN 


-  {/tr(f(ttr(t))2  +  /tr(i  0  -r  0  )2  +  uQ-t)cN} 


>  A  -  (t0+2)CN  >  0 


provided  that  <  A/(tg+2).  Hence  £q  ^  t.  Since  -*■  0  for  large 

CM  <  A/(tn+2).  Therefore 
N  U 

T 

P(tn^tn)  <  P(  u  (tr(f(t)-r(t))2  >  i  c  2]). 

U  t=0 

Theorem  3.1.  If  we  choose  satisfying  the  conditions 


iim  C.,  =  0  and  lim  /N  C  =  « 
N  N 

N-*»  N-*» 


then  E|W(,n)|*“  <  n  >  1  implies 


P(t0ft0>  =  0(N(N  C^)  n),  as  N  -  <*>. 


Also,  E  exp{hlW(n)|  }  <  «  for  some  h  >  0,  implies 

-5NC2 


p(tQ^tQ)  =  0(e  ^),  for  some  6  >  0. 


Proof .  Both  conclusions  of  this  theorem  follow  from  (3.13)  and  the 
given  in  (3.5)  and  the  well-known  results  of  limit  theorems  concern 
independent  random  variables. 


Q,  then 
(3.12) 


N,  we  have 

(3.13) 


expressions 
Lng  sums  of 


4.  CONVERGENCE  RATE  OF  FREQUENCY  ESTIMATES 


In  this  section,  we  establish  the  rate  of  convergence  of  the  frequency 


estimates  oj.  , .  . .  ,uj-  . 

0  <v 

Let  b  be  the  eigenvector  of  I  corresponding  to  the  smallest  eigen- 

2  0 

value  o  .  Also,  let 


( tn )  ,  .  (t  )  ,  (t  ) 

h  =  6[i-(f  u  -s  i)**(r  -s.  ik r  -s.  i)'')  (r  u  -s  ujb. 

*0  *0  C0  t0  t0  _t0 


(t  )  .  UnJ 

=  a[i-ir  -s  i)  if  -s  i ; ] b 
o  o  o 


(4.  u 


where  g  =  3  is  a  positive  constant  which  normalizes  b  to  unit  length. 
N  -tQ 


Note  that  and  S  -*  ,  with  probabilitv  one.  When  N  is  largt. 

0 

enough,  we  know  that 


Un;  u  ) 

[i-d  -s  n  d  -s  1 1 j b  ?  o 
co  co  ~lo 


Hence  b  is  well-defined.  It  is  easv  to  verifv  that  b  is  the  eigenvector  of 
j  'co  0 

f  ^  corresponding  to  the  smallest  eigenvalue  S 

0 


Bv  the  triangle  inequality  and  (4.1),  we  have 


|b  -b  |  <  2 1 c r  u  -s  i )  (r  -s  i)b  i 
o  o  o  o  o 


(4.2) 


Since  (r^^-o^I)b  =  0  and  I  b  I  =  1 ,  we  have 


-t 


0 


-<V 

|(T  u  -S  I)b.  I 

0  ~c0 


.^0  ^  ^  ^  9 

=  | ( r  -r  -  (s  -o“)i)b  i 

o  o 


-  ^  ^0^  T  1  9 

1  (trd  -r  )“]2  +  |S  -o“t 


8 


Hence 

-  _i  _(b~)  (V  ?  -  •? 

lb,  -b,  I  5  2  j  A  -S  I  { [tr(T  -r  U  )-]2  +  IS  -a- j }.  (4.3; 

~  0  -  0  0  0  0 

Now,  let  A  =  X  U?  -  o“  >  0.  Also,  let  n  >  0  be  a  small  number  such  that 
tQ-l 

n  <  A/4(  tg+1 ) .  Then,  for  t  =  tn,  using  (3.7)  |y^-y^5I  <  n,  j,  i  =  0,1 . tn, 


implies 


and 


'0 


j£  '  j  i  ' 


-Un)  un}  2  4 

[tr(r  u  -r  u  )z]2  <  (t0+i)n. 


|s  -o“|  <  (tn+l)n, 
0 


rU0J  /V  2  7  ,;(V  „(to\2j 

A  .  -  S  i  A  .  -  a  -  2(tr(i  -i  )  ) 

0  0  o 


>  A  -  2(tQ+l)n  >  2- 


(4.4) 


Thus,  by  (4.2)  -  (4.4), 


[  b  -  b  |  <  8(t_+l )A  *0  . 
0  0 


(4.5) 


For  any  e  >  0,  let  n  =  eA/ [ 8( tn+l ) ] .  Then  | y ^  “Y ^  |  in,  i,  m  =  0,1 . t 


implies  that 


|b  -  b  |  <  e. 
~c0  .0 


(4.6) 


Therefore 


p(|b  -b  I  i  e)  i  1°  1°  2 

0  0  4=0  m=0 


(4.7) 


Now,  define  |b^  -  b^  (  as  usual  if  b^,  b-,  have  common  dimensionality  and 

otherwise.  Also,  b  = ( bn , b  , . . . , br  )'.  From  (4.7)  we  have 

U  1  0 


P(  | b-b  |  ^  c 
'  ~C0 


)  _  P(  |  b  -b  I  €  )  f  P<  t  *t.n  ) 

Lo  0  u  u 


(4.8) 


From  (4.7),  (4.8)  and  what  has  been  proved  in  Section  3  we  obtain  the  following 


theorem. 

Theorem  4.1.  Let  be  chosen  satisfying  the  conditions 

(i)  lim  =  0  (ii)  lim  i/N  C^/v'loglogN  =  <*>. 
N-*»  'v 

Then  E|w(n)|2r1  <  «,  r)  >  1  implies 

P(|b-bt  j  >  e)  =  0(N(NCN)'n). 


Also, 


E  exp{hjw(n) |2} 


<  <*>  for  some  h  >  0 


(4.9) 


implies 


P(|b-b  j  >  e)  =  0(exp{-bNCM} )  for  some  b  >  0 
~  0  N 


(4.10) 


Since  the  roots  of  the  polynomial  are  continuous  functions  of  coefficients 
of  the  polynomial,  we  have 


Theorem  4.2.  Suppose  p.e1U)j,  j  =  0,1,..., t_  are  the  roots  or  l  d  z 

J  u  i=0  ^ 


°f  I°b, 


uij  6[0,2tt)  and  w/s  are  arranged  in  increasing  order.  Also,  exp(iuK>,  j=0,l,.. 


are  ranked  in  the  increasing  order  of  w..  In  addition,  let  z  =  (p^e110® ,  p^e11^ , 
i^t0  iaj  iu>to  J 

.  ..,p£e  )'and  z  =(elw®,...,e  )',  we  choose  satisfying  the  conditi 


:ions 


(l)  lim  C..  =  0,  (n)  lim  /N  Cm  //loglogN  -  00 . 

..  N  N 

N-*®°  N-**> 


,2n 


Then  E|w(.n)|“  <  °°,  n  >  1  implies 


P( 


|  z-z |  >  el  =  0(N(CNN)"n) 


14.11) 


ft 


Aslo, 


E  exp{hjw(n)|  }  <  °°  for  some  h  >  0 


(4.12) 


implies 


P(|z-z|>e)  =  0(exp{ -bNC^} )  for  some  b  >  0  (4.13) 

We  note  that  (4.12)  and  (4.13)  are  respectively  equivalent  to  the 

statements  that  P(max  jp  -l|>  e)  is  of  order  in  (4.9)  and 

^0 

P(max  |ui  -to  |  >_  e)  is  of  order  in  (4.10)  where  a  A  b  denotes  the  minimum  of 

a  and  b. 


